Pandas Profiling Report

Dataset statistics

Number of variables	13
Number of observations	20490
Missing cells	88
Missing cells (%)	< 0.1%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	2.0 MiB
Average record size in memory	104.0 B

Variable types

Numeric	10
Text	3

Alerts

`Unnamed: 0` is highly overall correlated with `df_index`	High correlation
`df_index` is highly overall correlated with `Unnamed: 0`	High correlation
`vividness` is highly overall correlated with `passive voice`	High correlation
`passive voice` is highly overall correlated with `vividness`	High correlation
`all adverbs` is highly overall correlated with `ly-adverbs` and 1 other fields	High correlation
`ly-adverbs` is highly overall correlated with `all adverbs`	High correlation
`non-ly-adverbs` is highly overall correlated with `all adverbs`	High correlation
`year` is highly skewed (γ1 = -24.16478369)	Skewed
`Unnamed: 0` is uniformly distributed	Uniform
`Unnamed: 0` has unique values	Unique
`df_index` has unique values	Unique

Reproduction

Analysis started	2023-06-11 17:22:43.967476
Analysis finished	2023-06-11 17:23:01.952007
Duration	17.98 seconds
Software version	ydata-profiling v0.0.dev0
Download configuration	config.json

Unnamed: 0
Real number (ℝ)

HIGH CORRELATION UNIFORM UNIQUE

Distinct	20490
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10244.5

Minimum	0
Maximum	20489
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	0
5-th percentile	1024.45
Q1	5122.25
median	10244.5
Q3	15366.75
95-th percentile	19464.55
Maximum	20489
Range	20489
Interquartile range (IQR)	10244.5

Descriptive statistics

Standard deviation	5915.0978
Coefficient of variation (CV)	0.57739254
Kurtosis	-1.2
Mean	10244.5
Median Absolute Deviation (MAD)	5122.5
Skewness	0
Sum	2.099098 × 10⁸
Variance	34988382
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
14086	1	< 0.1%
13664	1	< 0.1%
13663	1	< 0.1%
13662	1	< 0.1%
13661	1	< 0.1%
13660	1	< 0.1%
13659	1	< 0.1%
13658	1	< 0.1%
13657	1	< 0.1%
Other values (20480)	20480	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
20489	1	< 0.1%
20488	1	< 0.1%
20487	1	< 0.1%
20486	1	< 0.1%
20485	1	< 0.1%
20484	1	< 0.1%
20483	1	< 0.1%
20482	1	< 0.1%
20481	1	< 0.1%
20480	1	< 0.1%

df_index
Real number (ℝ)

HIGH CORRELATION UNIQUE

Distinct	20490
Distinct (%)	100.0%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	10982.804

Minimum	0
Maximum	22428
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	0
5-th percentile	1066.45
Q1	5455.25
median	10978.5
Q3	16483.75
95-th percentile	20921.55
Maximum	22428
Range	22428
Interquartile range (IQR)	11028.5

Descriptive statistics

Standard deviation	6367.7255
Coefficient of variation (CV)	0.57979051
Kurtosis	-1.2002347
Mean	10982.804
Median Absolute Deviation (MAD)	5514.5
Skewness	0.0040537727
Sum	2.2503765 × 10⁸
Variance	40547928
Monotonicity	Strictly increasing

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0	1	< 0.1%
15098	1	< 0.1%
14650	1	< 0.1%
14649	1	< 0.1%
14648	1	< 0.1%
14647	1	< 0.1%
14645	1	< 0.1%
14644	1	< 0.1%
14643	1	< 0.1%
14641	1	< 0.1%
Other values (20480)	20480	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
1	1	< 0.1%
2	1	< 0.1%
3	1	< 0.1%
4	1	< 0.1%
5	1	< 0.1%
6	1	< 0.1%
7	1	< 0.1%
8	1	< 0.1%
9	1	< 0.1%

Value	Count	Frequency (%)
22428	1	< 0.1%
22417	1	< 0.1%
22361	1	< 0.1%
22256	1	< 0.1%
22128	1	< 0.1%
22127	1	< 0.1%
22126	1	< 0.1%
22125	1	< 0.1%
22124	1	< 0.1%
22122	1	< 0.1%

title
Text

Distinct	19552
Distinct (%)	95.4%
Missing	0
Missing (%)	0.0%
Memory size	160.2 KiB

Length

Max length	90
Median length	64
Mean length	16.658175
Min length	1

Characters and Unicode

Total characters	341326
Distinct characters	91
Distinct categories	13 ?
Distinct scripts	2 ?
Distinct blocks	3 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	18834 ?
Unique (%)	91.9%

Sample

1st row	The Vanished Birds
2nd row	The Price of Honor
3rd row	The Case of the Baker Street Irregulars
4th row	Wildoak
5th row	The Holiday

Value	Count	Frequency (%)
the	8294	13.3%
of	2927	4.7%
a	1230	2.0%
in	805	1.3%
and	774	1.2%
to	489	0.8%
you	336	0.5%
for	289	0.5%
girl	286	0.5%
on	278	0.4%
Other values (11080)	46817	74.9%

Most occurring characters

Value	Count	Frequency (%)
	42044	12.3%
e	37352	10.9%
o	20703	6.1%
a	19021	5.6%
r	18797	5.5%
n	17830	5.2%
t	17432	5.1%
i	17291	5.1%
h	15092	4.4%
s	14462	4.2%
Other values (81)	121302	35.5%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	241848	70.9%
Uppercase Letter	54369	15.9%
Space Separator	42044	12.3%
Other Punctuation	1356	0.4%
Final Punctuation	1038	0.3%
Decimal Number	431	0.1%
Dash Punctuation	220	0.1%
Initial Punctuation	9	< 0.1%
Open Punctuation	4	< 0.1%
Close Punctuation	4	< 0.1%
Other values (3)	3	< 0.1%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
e	37352	15.4%
o	20703	8.6%
a	19021	7.9%
r	18797	7.8%
n	17830	7.4%
t	17432	7.2%
i	17291	7.1%
h	15092	6.2%
s	14462	6.0%
l	11188	4.6%
Other values (22)	52680	21.8%

Uppercase Letter

Value	Count	Frequency (%)
T	8839	16.3%
S	4962	9.1%
D	3292	6.1%
B	3243	6.0%
M	3227	5.9%
A	3086	5.7%
W	3004	5.5%
C	2933	5.4%
H	2542	4.7%
L	2505	4.6%
Other values (16)	16736	30.8%

Other Punctuation

Value	Count	Frequency (%)
:	548	40.4%
,	432	31.9%
.	127	9.4%
'	115	8.5%
&	81	6.0%
!	22	1.6%
?	21	1.5%
/	4	0.3%
#	3	0.2%
*	1	0.1%
Other values (2)	2	0.1%

Decimal Number

Value	Count	Frequency (%)
1	96	22.3%
2	68	15.8%
0	57	13.2%
9	44	10.2%
3	43	10.0%
4	38	8.8%
6	30	7.0%
8	26	6.0%
7	16	3.7%
5	13	3.0%

Open Punctuation

Value	Count	Frequency (%)
(	3	75.0%
[	1	25.0%

Close Punctuation

Value	Count	Frequency (%)
)	3	75.0%
]	1	25.0%

Space Separator

Value	Count	Frequency (%)
	42044	100.0%

Final Punctuation

Value	Count	Frequency (%)
’	1038	100.0%

Dash Punctuation

Value	Count	Frequency (%)
-	220	100.0%

Initial Punctuation

Value	Count	Frequency (%)
‘	9	100.0%

Currency Symbol

Value	Count	Frequency (%)
$	1	100.0%

Other Symbol

Value	Count	Frequency (%)
°	1	100.0%

Math Symbol

Value	Count	Frequency (%)
+	1	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	296217	86.8%
Common	45109	13.2%

Most frequent character per script

Latin

Value	Count	Frequency (%)
e	37352	12.6%
o	20703	7.0%
a	19021	6.4%
r	18797	6.3%
n	17830	6.0%
t	17432	5.9%
i	17291	5.8%
h	15092	5.1%
s	14462	4.9%
l	11188	3.8%
Other values (48)	107049	36.1%

Common

Value	Count	Frequency (%)
	42044	93.2%
’	1038	2.3%
:	548	1.2%
,	432	1.0%
-	220	0.5%
.	127	0.3%
'	115	0.3%
1	96	0.2%
&	81	0.2%
2	68	0.2%
Other values (23)	340	0.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	340270	99.7%
Punctuation	1047	0.3%
None	9	< 0.1%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
	42044	12.4%
e	37352	11.0%
o	20703	6.1%
a	19021	5.6%
r	18797	5.5%
n	17830	5.2%
t	17432	5.1%
i	17291	5.1%
h	15092	4.4%
s	14462	4.3%
Other values (72)	120246	35.3%

Punctuation

Value	Count	Frequency (%)
’	1038	99.1%
‘	9	0.9%

None

Value	Count	Frequency (%)
é	2	22.2%
ô	2	22.2%
í	1	11.1%
°	1	11.1%
â	1	11.1%
ø	1	11.1%
ç	1	11.1%

author
Text

Distinct	11194
Distinct (%)	54.6%
Missing	0
Missing (%)	0.0%
Memory size	160.2 KiB

Length

Max length	85
Median length	55
Mean length	13.895656
Min length	4

Characters and Unicode

Total characters	284722
Distinct characters	94
Distinct categories	11 ?
Distinct scripts	3 ?
Distinct blocks	4 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	7995 ?
Unique (%)	39.0%

Sample

1st row	Simon Jimenez
2nd row	Jonathan P. Brazee
3rd row	Anthony Boucher
4th row	C. C. Harrington
5th row	T. M. Logan

Value	Count	Frequency (%)
j	653	1.4%
	628	1.3%
james	488	1.0%
david	416	0.9%
a	411	0.9%
john	367	0.8%
m	355	0.8%
r	309	0.7%
l	286	0.6%
michael	282	0.6%
Other values (9617)	42914	91.1%

Most occurring characters

Value	Count	Frequency (%)
	26626	9.4%
e	26421	9.3%
a	25132	8.8%
n	20256	7.1%
r	18514	6.5%
i	16003	5.6%
o	14380	5.1%
l	14048	4.9%
t	10001	3.5%
s	9816	3.4%
Other values (84)	103525	36.4%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	205415	72.1%
Uppercase Letter	47179	16.6%
Space Separator	26626	9.4%
Other Punctuation	4991	1.8%
Dash Punctuation	170	0.1%
Nonspacing Mark	152	0.1%
Final Punctuation	120	< 0.1%
Open Punctuation	32	< 0.1%
Close Punctuation	32	< 0.1%
Initial Punctuation	3	< 0.1%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
e	26421	12.9%
a	25132	12.2%
n	20256	9.9%
r	18514	9.0%
i	16003	7.8%
o	14380	7.0%
l	14048	6.8%
t	10001	4.9%
s	9816	4.8%
h	7901	3.8%
Other values (33)	42943	20.9%

Uppercase Letter

Value	Count	Frequency (%)
M	4141	8.8%
S	4097	8.7%
J	3729	7.9%
C	3670	7.8%
A	3264	6.9%
R	2753	5.8%
D	2747	5.8%
B	2728	5.8%
K	2567	5.4%
L	2433	5.2%
Other values (19)	15050	31.9%

Nonspacing Mark

Value	Count	Frequency (%)
́	114	75.0%
̈	17	11.2%
̃	6	3.9%
̀	5	3.3%
̧	4	2.6%
̌	3	2.0%
̇	1	0.7%
̊	1	0.7%
̂	1	0.7%

Other Punctuation

Value	Count	Frequency (%)
.	4274	85.6%
&	628	12.6%
,	68	1.4%
'	21	0.4%

Final Punctuation

Value	Count	Frequency (%)
’	117	97.5%
”	3	2.5%

Decimal Number

Value	Count	Frequency (%)
5	1	50.0%
0	1	50.0%

Space Separator

Value	Count	Frequency (%)
	26626	100.0%

Dash Punctuation

Value	Count	Frequency (%)
-	170	100.0%

Open Punctuation

Value	Count	Frequency (%)
(	32	100.0%

Close Punctuation

Value	Count	Frequency (%)
)	32	100.0%

Initial Punctuation

Value	Count	Frequency (%)
“	3	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	252594	88.7%
Common	31976	11.2%
Inherited	152	0.1%

Most frequent character per script

Latin

Value	Count	Frequency (%)
e	26421	10.5%
a	25132	9.9%
n	20256	8.0%
r	18514	7.3%
i	16003	6.3%
o	14380	5.7%
l	14048	5.6%
t	10001	4.0%
s	9816	3.9%
h	7901	3.1%
Other values (62)	90122	35.7%

Common

Value	Count	Frequency (%)
	26626	83.3%
.	4274	13.4%
&	628	2.0%
-	170	0.5%
’	117	0.4%
,	68	0.2%
(	32	0.1%
)	32	0.1%
'	21	0.1%
“	3	< 0.1%
Other values (3)	5	< 0.1%

Inherited

Value	Count	Frequency (%)
́	114	75.0%
̈	17	11.2%
̃	6	3.9%
̀	5	3.3%
̧	4	2.6%
̌	3	2.0%
̇	1	0.7%
̊	1	0.7%
̂	1	0.7%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	284366	99.9%
Diacriticals	152	0.1%
Punctuation	123	< 0.1%
None	81	< 0.1%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
	26626	9.4%
e	26421	9.3%
a	25132	8.8%
n	20256	7.1%
r	18514	6.5%
i	16003	5.6%
o	14380	5.1%
l	14048	4.9%
t	10001	3.5%
s	9816	3.5%
Other values (52)	103169	36.3%

Punctuation

Value	Count	Frequency (%)
’	117	95.1%
“	3	2.4%
”	3	2.4%

Diacriticals

Value	Count	Frequency (%)
́	114	75.0%
̈	17	11.2%
̃	6	3.9%
̀	5	3.3%
̧	4	2.6%
̌	3	2.0%
̇	1	0.7%
̊	1	0.7%
̂	1	0.7%

None

Value	Count	Frequency (%)
ö	31	38.3%
ø	9	11.1%
é	6	7.4%
ð	6	7.4%
ó	5	6.2%
á	4	4.9%
ï	3	3.7%
ü	3	3.7%
ł	2	2.5%
ñ	2	2.5%
Other values (10)	10	12.3%

total words
Real number (ℝ)

Distinct	18537
Distinct (%)	90.5%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	92534.069

Minimum	984
Maximum	612956
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	984
5-th percentile	31555.85
Q1	70073
median	88249
Q3	107297.25
95-th percentile	163614.55
Maximum	612956
Range	611972
Interquartile range (IQR)	37224.25

Descriptive statistics

Standard deviation	43882.384
Coefficient of variation (CV)	0.47422948
Kurtosis	13.426078
Mean	92534.069
Median Absolute Deviation (MAD)	18546.5
Skewness	2.2965898
Sum	1.8960231 × 10⁹
Variance	1.9256636 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
78171	4	< 0.1%
77033	4	< 0.1%
70067	4	< 0.1%
95740	4	< 0.1%
67066	4	< 0.1%
96888	4	< 0.1%
84667	4	< 0.1%
77028	4	< 0.1%
71622	4	< 0.1%
77111	3	< 0.1%
Other values (18527)	20451	99.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
984	1	< 0.1%
1503	1	< 0.1%
1769	1	< 0.1%
2021	1	< 0.1%
2334	1	< 0.1%
2398	1	< 0.1%
2417	1	< 0.1%
2524	1	< 0.1%
2602	1	< 0.1%
2638	1	< 0.1%

Value	Count	Frequency (%)
612956	1	< 0.1%
612868	1	< 0.1%
593393	1	< 0.1%
567072	1	< 0.1%
535663	1	< 0.1%
503164	1	< 0.1%
502290	1	< 0.1%
501470	1	< 0.1%
486586	1	< 0.1%
480194	1	< 0.1%

vividness
Real number (ℝ)

Distinct	5178
Distinct (%)	25.3%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	47.655792

Minimum	1
Maximum	99.75
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	1
5-th percentile	29.04
Q1	39.64
median	47.2
Q3	55.14
95-th percentile	68.3
Maximum	99.75
Range	98.75
Interquartile range (IQR)	15.5

Descriptive statistics

Standard deviation	12.060809
Coefficient of variation (CV)	0.2530817
Kurtosis	0.56222192
Mean	47.655792
Median Absolute Deviation (MAD)	7.76
Skewness	0.26502122
Sum	976467.17
Variance	145.46311
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
50.14	20	0.1%
41	17	0.1%
41.78	16	0.1%
47.46	16	0.1%
47.37	16	0.1%
48.08	16	0.1%
43.28	15	0.1%
48.66	15	0.1%
47.75	15	0.1%
43.13	15	0.1%
Other values (5168)	20329	99.2%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1	< 0.1%
1.01	1	< 0.1%
1.02	3	< 0.1%
1.03	2	< 0.1%
1.05	2	< 0.1%
1.06	1	< 0.1%
1.07	4	< 0.1%
1.08	1	< 0.1%
1.11	1	< 0.1%
1.12	2	< 0.1%

Value	Count	Frequency (%)
99.75	1	< 0.1%
99.71	1	< 0.1%
98.81	1	< 0.1%
98.31	1	< 0.1%
98.28	1	< 0.1%
97.14	1	< 0.1%
96.79	1	< 0.1%
96.56	1	< 0.1%
96.18	1	< 0.1%
96.17	1	< 0.1%

passive voice
Real number (ℝ)

Distinct	798
Distinct (%)	3.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	8.0364924

Minimum	1.39
Maximum	12.87
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	1.39
5-th percentile	5.89
Q1	7.23
median	8.06
Q3	8.88
95-th percentile	10.08
Maximum	12.87
Range	11.48
Interquartile range (IQR)	1.65

Descriptive statistics

Standard deviation	1.2654327
Coefficient of variation (CV)	0.15746082
Kurtosis	0.28332088
Mean	8.0364924
Median Absolute Deviation (MAD)	0.82
Skewness	-0.15781941
Sum	164667.73
Variance	1.6013198
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
8.2	86	0.4%
8.17	84	0.4%
7.92	82	0.4%
7.77	81	0.4%
7.76	81	0.4%
7.85	80	0.4%
7.38	80	0.4%
7.99	80	0.4%
7.83	79	0.4%
8.59	78	0.4%
Other values (788)	19679	96.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1.39	1	< 0.1%
2.58	1	< 0.1%
2.66	1	< 0.1%
2.7	1	< 0.1%
2.72	1	< 0.1%
2.75	1	< 0.1%
2.84	1	< 0.1%
3	1	< 0.1%
3.02	1	< 0.1%
3.08	1	< 0.1%

Value	Count	Frequency (%)
12.87	1	< 0.1%
12.7	1	< 0.1%
12.68	1	< 0.1%
12.42	1	< 0.1%
12.35	1	< 0.1%
12.31	1	< 0.1%
12.3	2	< 0.1%
12.26	1	< 0.1%
12.25	1	< 0.1%
12.24	1	< 0.1%

all adverbs
Real number (ℝ)

Distinct	371
Distinct (%)	1.8%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.943572

Minimum	1.16
Maximum	6.54
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	1.16
5-th percentile	2.11
Q1	2.58
median	2.92
Q3	3.28
95-th percentile	3.88
Maximum	6.54
Range	5.38
Interquartile range (IQR)	0.7

Descriptive statistics

Standard deviation	0.53744769
Coefficient of variation (CV)	0.18258351
Kurtosis	0.47830799
Mean	2.943572
Median Absolute Deviation (MAD)	0.35
Skewness	0.34597734
Sum	60313.79
Variance	0.28885002
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2.97	192	0.9%
2.92	185	0.9%
2.9	184	0.9%
2.78	166	0.8%
2.91	166	0.8%
2.81	164	0.8%
2.87	164	0.8%
2.96	163	0.8%
2.98	162	0.8%
2.94	162	0.8%
Other values (361)	18782	91.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1.16	1	< 0.1%
1.17	1	< 0.1%
1.19	1	< 0.1%
1.27	1	< 0.1%
1.3	2	< 0.1%
1.31	1	< 0.1%
1.35	2	< 0.1%
1.36	1	< 0.1%
1.37	1	< 0.1%
1.38	2	< 0.1%

Value	Count	Frequency (%)
6.54	1	< 0.1%
5.72	2	< 0.1%
5.39	1	< 0.1%
5.35	1	< 0.1%
5.25	1	< 0.1%
5.21	1	< 0.1%
5.19	1	< 0.1%
5.13	1	< 0.1%
5.12	1	< 0.1%
5.1	1	< 0.1%

ly-adverbs
Real number (ℝ)

Distinct	251
Distinct (%)	1.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.0162211

Minimum	0
Maximum	4.39
Zeros	1
Zeros (%)	< 0.1%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	0
5-th percentile	0.51
Q1	0.78
median	0.99
Q3	1.22
95-th percentile	1.6055
Maximum	4.39
Range	4.39
Interquartile range (IQR)	0.44

Descriptive statistics

Standard deviation	0.33933842
Coefficient of variation (CV)	0.33392185
Kurtosis	1.3102762
Mean	1.0162211
Median Absolute Deviation (MAD)	0.22
Skewness	0.59184623
Sum	20822.37
Variance	0.11515056
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
0.83	284	1.4%
0.99	282	1.4%
0.96	272	1.3%
0.97	267	1.3%
1.02	265	1.3%
0.87	263	1.3%
0.85	261	1.3%
1.04	260	1.3%
1	257	1.3%
0.95	256	1.2%
Other values (241)	17823	87.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	1	< 0.1%
0.02	1	< 0.1%
0.04	1	< 0.1%
0.07	2	< 0.1%
0.08	1	< 0.1%
0.09	3	< 0.1%
0.1	1	< 0.1%
0.11	1	< 0.1%
0.12	2	< 0.1%
0.13	1	< 0.1%

Value	Count	Frequency (%)
4.39	1	< 0.1%
3.18	2	< 0.1%
2.68	1	< 0.1%
2.65	1	< 0.1%
2.64	1	< 0.1%
2.6	1	< 0.1%
2.58	2	< 0.1%
2.53	1	< 0.1%
2.52	1	< 0.1%
2.51	1	< 0.1%

non-ly-adverbs
Real number (ℝ)

Distinct	249
Distinct (%)	1.2%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1.9273812

Minimum	0.71
Maximum	3.87
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	0.71
5-th percentile	1.43
Q1	1.71
median	1.91
Q3	2.13
95-th percentile	2.48
Maximum	3.87
Range	3.16
Interquartile range (IQR)	0.42

Descriptive statistics

Standard deviation	0.32614114
Coefficient of variation (CV)	0.16921466
Kurtosis	0.7567445
Mean	1.9273812
Median Absolute Deviation (MAD)	0.21
Skewness	0.39009848
Sum	39492.04
Variance	0.10636804
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1.87	310	1.5%
1.9	307	1.5%
1.93	273	1.3%
1.94	272	1.3%
1.86	269	1.3%
1.82	266	1.3%
1.92	266	1.3%
1.89	264	1.3%
1.76	263	1.3%
1.79	263	1.3%
Other values (239)	17737	86.6%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0.71	1	< 0.1%
0.85	1	< 0.1%
0.87	1	< 0.1%
0.9	1	< 0.1%
0.93	3	< 0.1%
0.94	4	< 0.1%
0.96	2	< 0.1%
0.97	2	< 0.1%
0.98	5	< 0.1%
0.99	1	< 0.1%

Value	Count	Frequency (%)
3.87	1	< 0.1%
3.68	1	< 0.1%
3.53	1	< 0.1%
3.51	1	< 0.1%
3.48	1	< 0.1%
3.47	1	< 0.1%
3.44	1	< 0.1%
3.42	1	< 0.1%
3.41	1	< 0.1%
3.4	1	< 0.1%

year
Real number (ℝ)

Distinct	216
Distinct (%)	1.1%
Missing	88
Missing (%)	0.4%
Infinite	0
Infinite (%)	0.0%
Mean	2010.2646

Minimum	180
Maximum	2023
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	180
5-th percentile	1977
Q1	2013
median	2018
Q3	2020
95-th percentile	2022
Maximum	2023
Range	1843
Interquartile range (IQR)	7

Descriptive statistics

Standard deviation	38.175697
Coefficient of variation (CV)	0.018990384
Kurtosis	920.61849
Mean	2010.2646
Median Absolute Deviation (MAD)	2
Skewness	-24.164784
Sum	41013419
Variance	1457.3839
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
2020	3049	14.9%
2019	2757	13.5%
2018	2492	12.2%
2021	2070	10.1%
2017	1504	7.3%
2022	1228	6.0%
2016	1118	5.5%
2015	382	1.9%
2014	326	1.6%
2013	295	1.4%
Other values (206)	5181	25.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
180	1	< 0.1%
311	1	< 0.1%
351	1	< 0.1%
426	1	< 0.1%
701	1	< 0.1%
801	1	< 0.1%
1320	1	< 0.1%
1579	1	< 0.1%
1588	1	< 0.1%
1590	1	< 0.1%

Value	Count	Frequency (%)
2023	158	0.8%
2022	1228	6.0%
2021	2070	10.1%
2020	3049	14.9%
2019	2757	13.5%
2018	2492	12.2%
2017	1504	7.3%
2016	1118	5.5%
2015	382	1.9%
2014	326	1.6%

genres
Text

Distinct	3160
Distinct (%)	15.4%
Missing	0
Missing (%)	0.0%
Memory size	160.2 KiB

Length

Max length	97
Median length	84
Mean length	36.319131
Min length	9

Characters and Unicode

Total characters	744179
Distinct characters	35
Distinct categories	6 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	1937 ?
Unique (%)	9.5%

Sample

1st row	['Science Fiction', 'Fantasy', 'Adult']
2nd row	['Science Fiction']
3rd row	['Mystery', 'Crime', 'Classics']
4th row	['Historical Fiction', 'Young Adult']
5th row	['Thriller', 'Mystery', 'Crime', 'Suspense']

Value	Count	Frequency (%)
mystery	8000	11.7%
fiction	7947	11.7%
thriller	6659	9.8%
fantasy	5970	8.8%
adult	5222	7.7%
historical	4914	7.2%
science	3830	5.6%
crime	3765	5.5%
contemporary	3328	4.9%
romance	3234	4.7%
Other values (10)	15250	22.4%

Most occurring characters

Value	Count	Frequency (%)
'	115258	15.5%
r	51056	6.9%
	47629	6.4%
i	45507	6.1%
e	43390	5.8%
t	39136	5.3%
,	37139	5.0%
o	33058	4.4%
n	32433	4.4%
a	30654	4.1%
Other values (25)	268919	36.1%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	435054	58.5%
Other Punctuation	152397	20.5%
Uppercase Letter	68119	9.2%
Space Separator	47629	6.4%
Close Punctuation	20490	2.8%
Open Punctuation	20490	2.8%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
r	51056	11.7%
i	45507	10.5%
e	43390	10.0%
t	39136	9.0%
o	33058	7.6%
n	32433	7.5%
a	30654	7.0%
s	29144	6.7%
y	28787	6.6%
l	25813	5.9%
Other values (8)	76076	17.5%

Uppercase Letter

Value	Count	Frequency (%)
F	13917	20.4%
M	8984	13.2%
C	8151	12.0%
H	7721	11.3%
S	6767	9.9%
T	6659	9.8%
A	6565	9.6%
R	3234	4.7%
Y	2543	3.7%
P	1301	1.9%
Other values (2)	2277	3.3%

Other Punctuation

Value	Count	Frequency (%)
'	115258	75.6%
,	37139	24.4%

Space Separator

Value	Count	Frequency (%)
	47629	100.0%

Close Punctuation

Value	Count	Frequency (%)
]	20490	100.0%

Open Punctuation

Value	Count	Frequency (%)
[	20490	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	503173	67.6%
Common	241006	32.4%

Most frequent character per script

Latin

Value	Count	Frequency (%)
r	51056	10.1%
i	45507	9.0%
e	43390	8.6%
t	39136	7.8%
o	33058	6.6%
n	32433	6.4%
a	30654	6.1%
s	29144	5.8%
y	28787	5.7%
l	25813	5.1%
Other values (20)	144195	28.7%

Common

Value	Count	Frequency (%)
'	115258	47.8%
	47629	19.8%
,	37139	15.4%
]	20490	8.5%
[	20490	8.5%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	744179	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
'	115258	15.5%
r	51056	6.9%
	47629	6.4%
i	45507	6.1%
e	43390	5.8%
t	39136	5.3%
,	37139	5.0%
o	33058	4.4%
n	32433	4.4%
a	30654	4.1%
Other values (25)	268919	36.1%

num final genres
Real number (ℝ)

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.8125427

Minimum	1
Maximum	7
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	160.2 KiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	2
median	3
Q3	4
95-th percentile	5
Maximum	7
Range	6
Interquartile range (IQR)	2

Descriptive statistics

Standard deviation	1.2048063
Coefficient of variation (CV)	0.42836907
Kurtosis	-0.68176067
Mean	2.8125427
Median Absolute Deviation (MAD)	1
Skewness	0.13998482
Sum	57629
Variance	1.4515582
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
3	6005	29.3%
2	4835	23.6%
4	4640	22.6%
1	3463	16.9%
5	1369	6.7%
6	170	0.8%
7	8	< 0.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	3463	16.9%
2	4835	23.6%
3	6005	29.3%
4	4640	22.6%
5	1369	6.7%
6	170	0.8%
7	8	< 0.1%

Value	Count	Frequency (%)
7	8	< 0.1%
6	170	0.8%
5	1369	6.7%
4	4640	22.6%
3	6005	29.3%
2	4835	23.6%
1	3463	16.9%

Auto

Heatmap
Table

	Unnamed: 0	df_index	total words	vividness	passive voice	all adverbs	ly-adverbs	non-ly-adverbs	year	num final genres
Unnamed: 0	1.000	1.000	-0.028	-0.017	0.010	0.010	0.012	0.002	-0.012	-0.043
df_index	1.000	1.000	-0.028	-0.017	0.010	0.010	0.012	0.002	-0.012	-0.043
total words	-0.028	-0.028	1.000	-0.017	-0.004	-0.004	0.024	-0.020	0.013	0.112
vividness	-0.017	-0.017	-0.017	1.000	-0.520	-0.344	-0.261	-0.312	0.060	0.119
passive voice	0.010	0.010	-0.004	-0.520	1.000	0.334	0.101	0.464	0.044	0.133
all adverbs	0.010	0.010	-0.004	-0.344	0.334	1.000	0.803	0.795	-0.139	0.011
ly-adverbs	0.012	0.012	0.024	-0.261	0.101	0.803	1.000	0.317	-0.149	-0.047
non-ly-adverbs	0.002	0.002	-0.020	-0.312	0.464	0.795	0.317	1.000	-0.060	0.071
year	-0.012	-0.012	0.013	0.060	0.044	-0.139	-0.149	-0.060	1.000	0.003
num final genres	-0.043	-0.043	0.112	0.119	0.133	0.011	-0.047	0.071	0.003	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	Unnamed: 0	df_index	title	author	total words	vividness	passive voice	all adverbs	ly-adverbs	non-ly-adverbs	year	genres	num final genres
0	0	0	The Vanished Birds	Simon Jimenez	124205.0	55.18	6.37	1.95	0.36	1.58	2020.0	['Science Fiction', 'Fantasy', 'Adult']	3
1	1	1	The Price of Honor	Jonathan P. Brazee	77253.0	35.35	8.71	2.63	0.71	1.92	2017.0	['Science Fiction']	1
2	2	2	The Case of the Baker Street Irregulars	Anthony Boucher	80557.0	32.33	8.41	3.72	1.64	2.08	1940.0	['Mystery', 'Crime', 'Classics']	3
3	3	3	Wildoak	C. C. Harrington	55602.0	74.34	6.92	3.04	1.16	1.87	2022.0	['Historical Fiction', 'Young Adult']	2
4	4	4	The Holiday	T. M. Logan	101767.0	50.30	8.02	3.06	1.12	1.93	2019.0	['Thriller', 'Mystery', 'Crime', 'Suspense']	4
5	5	5	Fab: An Intimate Life of Paul McCartney	Howard Sounes	225785.0	39.24	6.52	3.03	1.20	1.83	2010.0	['Biography', 'History']	2
6	6	6	Honest illusions	Nora Roberts	163279.0	55.45	8.31	2.72	0.95	1.77	1992.0	['Romance', 'Contemporary', 'Mystery', 'Suspense']	4
7	7	7	Fifth Business	Robertson Davies	103691.0	29.82	8.80	3.46	1.12	2.34	1970.0	['Classics', 'Historical Fiction', 'Literary Fiction']	3
8	8	8	Spy Above the Clouds	Ciji Ware	161061.0	47.38	6.98	3.32	1.35	1.97	2021.0	['Historical Fiction']	1
9	9	9	If Then	Jill Lepore	109677.0	27.46	5.77	2.16	0.77	1.39	2020.0	['History']	1

	Unnamed: 0	df_index	title	author	total words	vividness	passive voice	all adverbs	ly-adverbs	non-ly-adverbs	year	genres	num final genres
20480	20480	22122	Star Wars - The Mandalorian: Junior Novel	Joe Schrieber	39247.0	52.42	5.99	2.31	0.85	1.46	2022.0	['Science Fiction']	1
20481	20481	22124	The Three Secret Cities	Matthew Reilly	90879.0	59.78	5.77	2.67	1.15	1.53	2018.0	['Thriller', 'Adventure', 'Fantasy', 'Mystery', 'Suspense']	5
20482	20482	22125	The Love Songs of W. E. B. Du Bois	Honorée Fanonne Jeffers	260464.0	47.46	8.67	2.43	0.54	1.90	2021.0	['Historical Fiction', 'Literary Fiction', 'Historical']	3
20483	20483	22126	In Veritas -	C. J. Lavigne	128055.0	82.66	6.83	2.74	1.15	1.59	2020.0	['Adult', 'Fantasy', 'Science Fiction']	3
20484	20484	22127	Star Wars - The New Jedi Order: Vector Prime	R. A. Salvatore	118450.0	42.30	5.46	3.38	1.48	1.90	1999.0	['Fantasy', 'Science Fiction']	2
20485	20485	22128	Blessing in Disguise	Danielle Steel	82682.0	25.47	10.01	3.24	1.03	2.22	2019.0	['Romance']	1
20486	20486	22256	Moth	James Sallis	56267.0	52.27	7.19	3.37	1.10	2.27	1993.0	['Mystery', 'Crime', 'Thriller']	3
20487	20487	22361	True Blue	Jane Smiley	73746.0	50.61	8.61	3.21	0.56	2.65	2011.0	['Young Adult', 'Historical Fiction']	2
20488	20488	22417	Cage of Glass	Genevieve Crownson	70143.0	49.93	7.62	3.11	1.23	1.88	NaN	['Young Adult', 'Science Fiction']	2
20489	20489	22428	The Singing Sands	Josephine Tey	68986.0	40.43	9.29	2.78	0.78	2.00	1952.0	['Mystery', 'Crime', 'Thriller']	3

Overview

Variables

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Uppercase Letter

Other Punctuation

Decimal Number

Open Punctuation

Close Punctuation

Space Separator

Final Punctuation

Dash Punctuation

Initial Punctuation

Currency Symbol

Other Symbol

Math Symbol

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Punctuation

None

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Uppercase Letter

Nonspacing Mark

Other Punctuation

Final Punctuation

Decimal Number

Space Separator

Dash Punctuation

Open Punctuation

Close Punctuation

Initial Punctuation

Most occurring scripts

Most frequent character per script

Latin

Common

Inherited

Most occurring blocks

Most frequent character per block

ASCII

Punctuation

Diacriticals

None

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Uppercase Letter

Other Punctuation

Space Separator

Close Punctuation

Open Punctuation

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Interactions

Correlations

Missing values

Sample